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ABSTjFtACt 
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personnel improve their knowledge arid skills iri providing learning 
experiences that are adapt ive to student differences, particularly in 
the context of the effective mainstreaining of except ional students in 
regular classrooms. Findings from a study investigating the 
effectiveness of using the data-based approach to staff development 
in i.mproving classroom impleme of the ALEM are discussed . Data 

^^P'^.^t he study are reported as prelim the 

effectiveness of the data-based approach to staff development, and 
future lines of work in this area are suggested. (Author/CJB) 



********************************************************* 

* Reprbduct ibris supplied by EDRS are the best that cari be made * 

* f rpiii the or igirial dbcumerit . * 

********** *.* ***$<*t^***************************************************** 



ERIC 



N 
IlJ 




ENT CENTER 



ANALYSIS OF THE DESIGN, IWPLEMENTATION, AND 
EFFEeiS OF A DATA-BASED STAFF DEVELOPMENT PROGRAM 



MARGARET WANG AND PATRICIA GENNARI 



OS OtPARlMENT OF EDUCATION.. 

fjMKlNALINSinUU Of EDUCATION. 



1 



ANALYSIS OF THE DESIGN, IMPLEMENTATION, AND 
EFFECTS OF A DATA-BASED 
STAFF DEVELOPMENT PROGRAM 



Margaret C, Wang and Patricia Gehharl 



Learning Research and Deveidprrieht Center 
University of Pittsburgh 



1084 



Reprinted from Teacher Educattoh and Special Educatioh, 1083, 6, 211-116. 
Used by permissibri of Special Press and the Teacher Education Division. The 
Cbiihcil Tor Exceptibhai Children. 

The research reported herein was supported by the Learning Research and 
Development Center, funded in part by the National Institute of Education (NIE). 
U. S. Department of Education. The opinions expresr^ed do not necessarily reflect 
the position or policy of and no official endorsement should be Inferred. 



4 



ABSTRACT 



This article descripes tne design^a^^^ of 
a data based approach to training school staff 
M ^he imp^mentatJon of innovative programs. 
^^^^^Wy^^ !9 ^'7ysfraf//7g the use of thispariicw 
far approach, the artlcie summarizes themd- 
ings from a study of the efficacy of thepata- 
^9^^ Staff Deveiopment Prbgraw, this pro- 
?^J^1^ fca/Zy to help schoo l per- 

sonnei improve their knowj^edge and skills in 
providing learning experiences that are adap- 
tive to student differehces, particaiariy in the 
context of the effective ^^^^^^ bf_ ex- 

cepiionai students in ri^oj^i' Ctass^^ 
from the study are reported as preiiminary evi- 
dence of the e f fectiveness of the daia-t ised ap- 
P^§^^_ ^PJ^y^Jf j^^y^lopmeht, and future iihes of 
work in this area are suggested. 



PUririg the past two decades, great strides have 
^ft" jTlade In. research oh effective schooling 
!0 ^^^?y3^9Pl^^J)^A^ Innovative programs 
aimed at Improving schools' capabilities topfo- 
vide effective educational services. Neverthe- 
L^AS, there have been very few examples of suc- 
CQ^^MJi^oP^i'?'!^^^^^^ of those 

educationaj Innovations found to be demon- 
strably effective (Wang & Ellett, 1982). A rnajor 
piX5bjem_ls_t]ie lack of adequate training sup- 
P9^A^P''_ ^^pse school who are re^ 

sponsible for Implementing [nriqvatlve pro- 
grams (see, for exarriple, Reynolds, 1982). 
Although the critical heed to Include systematic 
staff developrneri an Integral cbmpRDheht of 
schobi Improvement efforts |n general and the 
Implemehtation of Innovative programs In par- 
ticular has been widely recbgriizcKJ, progress In 
this area has been spqt^^^^^ best, it Is In this 
context that the work on the deyejqpment and 
field testing of a data-based approach to staff 
development described here was initiated. 

T^!^_?^L^jQ_!^|isJw^ pyrppses. The f Irstjs to 
describe the rationale and deslgn^of the Data- 
Based Staff Development Program, which has 
b<*9h developed to train school staff to imple- 
r^^^^tjie Programmatic an^ porsbhhel changes 
required to effectively estabijsh and malritairi 
an Innovative educationaj program, the Adap- 
tive Learning Environments Model (ALEM), in 
ciassroorrijettjngs. It will aisb present and dis- 
cuss the Implications of findings from a study 
investigating the effectiveness of using this 
data-based approach to staff deveiopment in 
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imp^roving classrbbm Implementation of the 
ALEM. 



OVERVIP' 



DEPROGRAM 



A basic r ase underlying the design of the 
Data-Based Staff Development Program Is that 
establishing and malritalhihglhridvatlye school 
programs require hot oriiy detailed specm 
tibri bf the programs' designs and operating fea- 
tures, but also staff development activities that 
prornote understanding bf the programs and 
support their day-tOHjay Implementation (VVang, 
1931). Toward this end. staff development pro- 
grams must have certain characteristics. For 
example, they must be adaptive. Teachers (and 
other professlbnal arid paraprqfesslonal sUffj 
learn In different ways. More Importantly, they 
cdrtie to the classroom at different stages of 
learning. Thus, staff develbpmerit progranis 
mast be tailored tb the Identified strengths and 
weaknesses of Iridlvjduals. not of the group at 
large. J n addition to beimg adaptive, staff devel- 
opment programs must fbcus bri the d ay-to-day 
Implementation prbblems th^t teachers face 
and must be continuous, assisting teachers 
every step of Jhe way. Inservice prbgrams that 
occur every 6 months, br_everi every 2 or 3 
months, are Inadequate. Teachej-s need fre- 
quent contact arid continuous support in their 
ef fbrts to solve t50th short- andjorig-rarige prob- 
lems (eralckshanl<. Lorlsh, i Thompson, 1979; 
Griffin, 1979;_ McLaughlin & Marsh. 1979; 
M.cNergriey, 19^; Miller & Wolf, 1979; Perry. 
19»D; ZigarmI, Amory. & Zlgarmy. 1979L 

T?ie Data-Based Staff Develbpmerit Program 
was designed tb meet these support needs. 
Specifically, It airiis to help school personneke- 
spohslble fdrprogram implementation system- 
atically analyze relevant data on program impie- 
mentation and student butcbmes jn assessing 
their staff develbpmerit needs. The goal is to 
serve as a self-monltoring tool that increases 
the proflc[ency of school peKsonnel In establish- 
ing and maintaining prbgram Implementation. 
While designed tb accommodate the staff de- 
velopment rieeds of a specific educational pro- 
gram, the Adaptive Learning Environments 
Model, findings related tb the efficacy of this 
program are expected to cqntrl^bute to assess- 
ment of the merit of data-based approaches to 
staff development in general. 



Environments Model JALEM) 

The overall goal of the ALEM Is tb create school 
learning environments in which each student, 
exceptional arid ribriexceptlonal alike, can ac- 
quire basic academic skills and, simultaneous- 
ly, become Increasingly more conf ident iri his or 
her ability to learn and to cope with the socjal 
and physLcai_sUrrburidlngs 0^ the classroom 
{VVarig. 1980}. This goal Is accomplished by cbm- 
biningihe advantages of a highly structured 
programming component (which include*^ a 
built-in, diagribstrc-prescriptjve procedure \cr 
the development of ^kills in basic academic 
subject areas) with a more operi-ended, explora- 
tory learning component (which iricludes a vari- 
ety of prbblem-sblvirig arid sjudent-initiated ac- 
tivities for sociaj and personal development). 
Among the major expected outcomes bf_the 
ALEM for students are effectivejise of school 
time, mbtlvatibri tb spend the time required to 
master basic academic sl<llls, and development 
of increased competence In Irideperidently 
managing learning and the classroom environ- 
ment. Teachers are expected to be able to 
spend iricreased amounts of time providing iri- 

struction rather than rnanaglrig studerits. 

The uriderlyingassumptibribf the ALEM's de- 
sign Is that the !nlp[ementatlon of innovative 
educatidrial programs requires fundamerital 
changes in the nature and structure bf curricu- 
lar materials, instructlorial prbcedjres. organic 
zatlonal arid staff support systems, teaching 
and learning processes, and the roles of te_ach- 
er3 and students. Because bf the ALEM's 
unique program deslgri arid the changes In 
teacher arid student roles required to effectively 
estabMsh and maintain program implemerita- 
tion. the development of a staff develdjimenj 
program that prbyldes school persqrinel with 
appropriate technical assistance has been^ a 
majbr research effort In the design and field 
testing of the ALEM (Wang. 1983). 



Design of the^bata-Based 
Staff Development Program. 

The Data-Based Staff Develbpmerit Prdgram 
comprises a tralrilrig seqUerice, a set of mea- 
sures for assessing the degree of program Im- 
pleriieritatjon^and a method for asing a riuriiber 
of data sources to design staff develdpmerit 
plans that meet the needs bf iridivldual teachers. 
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Training Seqaence The Data--Based Staff De- 
yelppment Program incorporates three levels of 
^CSiining, ranging from initial awareness training 
^^^^"9^^^9 i'^ser^^^ 1 shbvys 

the training levels and sequentjal sjeps. Level I 
provides basic working knowledge of the currlc- 
ular content and procedures ihcbrporated in the 
AtEM. In Level l[, more Intensive training is pro- 
vided in specific staff functions. Level III pro- 
vides clinical training tailored to the needs of in- 
dividual staff members. Traihing at Level Hi is 
i^so'^'^Q A''^ to help 

school staff members continually improve and 
upgrade their classoom Impiementatlon; It is 
primarily at the third level that the iterative pro- 
J^l ???®?sment, feedbac plahhirig, and 
training occurs (Wang, 1981): 

1 . Level I: Basic Training, Training at Level I 
provides ah overview of the ALEM and working 
*^"^^1®^90 3^9^1 Jmplemehtatidh require- 
ments of the various program components. The 
three major topjc_areas are (a) the rationale and 
de:^lgn of the ALEM and pirbgram evaluatibh re- 
^^^^^\i^l^^J^^Pr^^^ program's cbmpi> 

nents; and (c) the knowledge and skills required 
for prbgram Impiementatlon (e.g., information 
P_n_the cdhtent of the basic skills and explbra- 
'®^''"!"9_3''®^s;^ P''pcedures jdr diaghbst Ic 
testing, prescription writing, and record keep- 
ing- design bf the classroom environment; man- 
sige.^ont and display of learhlhi] materials; and 
procedures for self-schedujlng). Level I staff de^ 
veiopment activities generally are scheduled as 
preimpieinentatloh sessions. TTiey are designed 
tpr_;al] re[evant administrative persbhriel (from 
central admjnistratlve staff to those at the bulid- 
i^ng level), as well as for lnstructiona[and other 
sUppbrt personnel whose duties affect the Irn- 
PjQn^Qntatidn bf the ALEM. The basic traihing 
level generally j'equlres 2 or 3 days^ 

2. Level 11: Individaalized Training, Level II 
staff development activities provide In-depth 
t''a'DJ^JltJlat is specific tb each staff member's 
functions. Based or^analysesofschbbj-spec 
needs, a detailed plan for each school's pro- 
gram implemehtatioh Is developed. DlfferehtN 
^ti9d staff ti^aihlhg activities are designed ac- 
cording to an analysls^Mhe functions to be 
carried out in the Impbmentatlon of the ALEM 
and assignment of those functions to person- 
nel. 

_ A'^JD^i^A^?^ ^'9yrA''_»±n^JvldUall2ed train- 
ing is provided to classroom teachers, teacher 



aides, instructional leaders, family specialists, 
bunding admlhlstratbrs, and central office ad- 
^'"'^A''3^P''?\^l^AtMej'Q (I train- 

ing varies by school and inst^ructjonal leader, 
depending on each school's unique constraints 
sind the staff's Understanding of their roles and 
'n^'vlduajlzed trairiihg sessions, 
which last 2 or 3 days, generally are scheduled 
immediately after Level I basic training ses- 
sions. Levels I and II can be completed in one 
week-long workshop prior tb the bpehihg bf 
school. 

3. Level 111: Inservice Traihing. Level III is 
the^ujmjnatibh bf ah Interactive process of pro- 

9''^"^ASS®s^"!'®Z^A!JQ65^^^^ arid pri- 

gbirig staff development work. It provides the 
technical sUpport required to establish and 
?^A'D^ain program impleriientatibri at school 
sites. Because Irisej^ice trajningjs designed to 
bi adaptive to the needs and expertise of indi- 
vidual staffs Jhe type and frequency of the ses- 
s'Of^s vajy. They rarige^ short meetings 
(during teacher preparation times) tb half-day 
workshops. 

__^s shbwri In FigUre 1 , the two typesof Level HI 
_s??slqns are staff plahhirig sessions 
and sessions for feedback and training. Staff 
pjahriing sessions are designed to develop 
plans for accbmpllshlrig s^ 
learning ob[ectlve^s and to d^^^ fbr 
staff feedbacl< and training. Staff plann[ng Is 
based on irifbrmatjbri from classroom observa- 
?[*^^s» J^_ata bri stUde^^ learning progress, and 
feedback from fjmilly memlMrs^ Sessibris fbr 
staff feedback and training are scheduled regu- 
larly thrbughbUt the school year, according to 
s^ai^ JrQ?^^''s' rieeds arid Iriterests, They pro- 
vide opportunlties^to djscuss criticaJ^issUes re- 
lated to program Impiementatlon, particularly in 
terrris of program reflriemerit and improvement 
Lri tjie degree bfprograrii Iriiplemeritatlor. Feed- 
and trajning sess|biis U^ place 
during regular staff planning times or during 
schbbis' scheduled team meetings and inser- 
vice trairilrig tiriies. 

DegrM of Program implementation Measunis 

A prerequisite fbr Implementing an innovative 
educatloriaL prbgram Is the availability of Infor- 
mation on the extent to which the pj-bgraril's d^ 
sigh is actually Implemented. The development 
bf degree bf implementatlbh measures to as- 
sess the preserice arid abserice bf the ALEM*s 
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esserit|al design features began with the Ideritl. 
ficatlon bH2 critical dimensions. These dlmen- 
sibns were Identified by anaiyzing the 
program's struct uraj and action dbrrialns. The 
structoraMomaln refers to those aspects olf the 
program's design that are required to establish 
the conditions under which program activities 
can be Implemented effectively. The action do- 
main consists of thq^se roles and be of 
instructional staff and students necessary for 
effective functioning under the ALEM. After the 
critical dimerisldhs were Idehtlfled. perfor- 
mance indicators werojJerived fo each dimen- 
sion. Ninety-six performance Indicators for as- 
sessing the irnplementatioh of the 12 critical 
^L'Tlo'lslons wer^^ arid grouped Into a 
battery of six data collection forrns Known as 
the Implementatlori Assessment Battery for 
Adaptive Instructloh OVarig, Catalano, & But- 
cher, 1«B3X 

Two of the forms in the ^atteiyrecond dyna- 
mic aspects of program implementation— the 
Teacher Instructional Roies_and interactions 
bbseryatlon Forrn and the Student Learning 
Process and^ehavjons Obseryatlon^ Forrn— 
and are adniinistered during ciass time, while 
students arid teachers engage in the instruc- 
tlonal-leamlng proce^^ Two fbrrhs focus bri 
nondynamic obsej^ables-— the _pbse(Vatiqn 
Checkiistfor Physical Design of the Classroom 
arid the Observatibri Checklist fbr Classroom 
Records— and are j^Jrhinistered before or after 
class time. The final two fornns are Inteiyiew 
questionnaires designed to elicit comments 
frbrii studerits arid teachers on various aspects 
of progrsmi irnplerrie^^ 

viewSchedale and the Teacher Interview Sched- 
ule. The Teacher interview Schedule Is adminis- 
tered befbre or after class tirrie, arid the Student 
Interview Schedule Is administered d urihg class 
time. 

The battery is regularly used by school per- 
sbririej (e.g., teachers, principals, tearn leaders, 
Q^ycatjon^ ?pQciaHsts) to cbllect iniplementa- 
tlon information for the lnseryice trainlryj com: 
ponent of tfie Data-Based Staff Development 
Prbgrarri. Schbdl personnel are encouraged to 
yse IhQ data c^silectldri fprriis, as rteederl^ to 
monitor the program Implementation jn their 
classrooms. Data also are collected at least 
three tinries dtjriri§ the school year (usually In 
P_cibber, Febrtjary^and April) for program evalu- 
ation purposes. It Q^J^eraliy takes about 2 hours 
per classroom to administer the entire Imple- 
mentation Assessment Battery for Adaptive In- 



struciioh. Ah empirical validation study of the 
battery suggests its validity and reliability; The 
interqbseiver reliability coefficients for the 12 
dimensions varied from .48 to .91 , with a median 
bf .74 (Strom & Wang, 1982); 

_^ computer prbgrarri was developed to ana- 
'y^® and^repqrt degree of Imp data 
in a form that can be used by site personnel to 
design and monitor site-specific staff develop- 
ment plaris (Schriildhariimer, 1982). Figure 2 is a 
sarnple cornputer prjritq^^ qf ari arialysis bf the 

degree of Implementation data^ 

As shown (n the figure, the data are analyzed 
at four levels: site (schpbl district), school, 
grade leveK and cjass (teacher). The riieari 
scores foi^the critical dlmensiojis qf the ALEM 
arerepbrtedin 12separatecolumns.Thenames 
and acrqriyms for the diriierisibris are listed at 
the top of the pnhtdut. The number in parerith^ 
ses under each acronym Indicates the tqtal 
riurhber bf perfbrrriarice indicators included In 
thQ battery that assess the degree bf Implemen- 
tation of that '^irnensiqn^The printbut [ricludes 
irifbrmatibri on each teacher's degree of imple- 
rrieritatlbri bf the 12 critical dirhenslons, as well 
^sLl^Qsin percentage qf the degree bf iriiple- 
mentatlon for eacfi gfcide within a school, for a 
given school, for grade levels across a school 
district, arid fbr the eritlre district. 

The cr|tefiqn for J high degree bf Inipleriierita- 
tlon of a critical dimenslqn has been set al85%. 
That Is, when 85% or more of the performance 
Irtdlcatbrs iri a giveri dirhensiori are present, the 
degree qfjrn^plemeritatlqn of that jSrbgram di- 
mension is considered "h[gh.'' JVhen 50% tq 
84% of the Items are present, Implementation 
bf that prbgrarri difherisibri Is cbrislderecl "aver- 
age,^* and the presence bf less thari 50% bf the 
performance indicators suggests "low" Imple- 
mentatibri. Using these criteria. Figure 2 shows, 
for exajftlpie, that all of the classes iri School A 
except Grade 2 achieved a M[gh degr^ imple- 
mentation of the l^istructing (INST) d|mension. 
Grade 2 had an average degree of irhplernenta- 
tlbri scqre (79% of ihe perfbrmarice indicators 

present). 

The overall degree of implementation across 
a variety bf schbbis for an extended period of 
time can provide eviderice bf the "implementa- 
bllity''qf the ALEW^m addjtlqnj^^ 
plementatlbn of particular dimensions can be 
arialyzed for Incjividual teachers, grades, 
schoqis, and districts tq assess trairilrig rieeds 
ar[d develqp specif Ic staff develqpment plaris. 
Analyses of the changes In degree of implemen- 
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Sample oorhputWr prl^^^^ summary of 

degree of implementation data 



tatloh from one assessment period to the next 
can \jrc'A6e Ihfdrrhatlbh to teachers atxSut their 
{ndividyaj implementation progress^ as well as 
thtfi data base for evaluating the effectiveness of 
st&ff development effarts. 

Adiiptfw Staff DmIopiTMfnt Plans, thr bata- 
Baaed Staff Development Program Is bpuratlbh- 
allzed In schob! sites thrbu^i^ site^speciflc staff 
dev^lbpmeht plans. A comprehensive staff de- 
velopment plan Is developed for eoch site at the 
begiinnlng of every school year. Theplari is based 
on a s ariety of Infbrmatlbh, Iricludlhg degree of 
jmplemehtatlbh and student learnmg progress 
data from the spring of the previous school year 
(tor new teachers or new implementation s/tes, 
from the beginning of the school year), each 
site's Identified staff development needs, and 



the major categories of activities proposed to 
meet those needs during theyear. Staff develop* 
merit plans Include (a) a de»cfiplloho^^ 
training task^qbjectiyes for performance Indi- 
cators In critical dimensions that consistently 
show scores below the 86% crlterlbri level 
across a si^riif|carit riumber of teachers f^^^ 
particuiar teacher), (b) dates the training is to be 
completed, (c) pere6h(s) respcrislbie for train- 
ing, (d) types bf activity to be cbndUcted. (e) ex- 
pected bUCcbmes, and (0 Qvidence^of effe^^^^ 
service as IJ relates to successful completlori of 
the training. Figure 3 shows an excerpt frorii a 
sample staff develbpriierit plari. 

Staff deyelbpmerit plans are reviewed peribd- 
ically by site personnel to determine the appro- 

P''L^^®D^??J^iPL?^'^"?^J''5^"^"9 objectives and to 
monitor progress. Monthly training logs, kept by 
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education speclallsjs or principals, are a rnajor 
scarce of information for reviewing each site's 
progress and updating Its staff development 
plans. The logs Include descriptions of imple- 
rnent^tjon-related behav[or, specif Ic strategies 
for improving the degree of implementation 
(e.g., classroom observations, conferences be- 
tween teachers and education specialists, and 
Ins^rvjce tj-alning workshops), expected out- 
comes, and foilow-ap activities. In addition to 
periodic reviews, when staff development plans 
for each site are updated and revised If needed, 

the three periods for collecting degree of imple- 
mentation data. Figure 4 shows a sample train- 
ing log. 



THE STUDY 

During the 1980-81 school year, the effective- 
ness^ of th^ Dat a-^Based Staf f^evejopjTient Pro- 
gram in improving classroom Implementation 
of the ALEM was investigated, this descriptive 
study Is part of an brigbiriia prbgrarti of research 
designed to provide information for systematic 



Irnprovement of the ALEM and Its implementa- 
tion in a variety of school settings, Inclading 
classrooms where mildly handicapped and gift- 
ed students are malhstrearned with regular stu- 
dents on a full-time basis. 

Setting 

The setting for the study consisted bf 10 schbbi 
djstrlct sites, Jnduding 138^ kindergarten 
through fourth grade classrooms. The school 
districts, located in areas with varying ethnb- 
culturai, sbclbecbhbmic, and geographic char- 
acteristics, Include injier-cjty 
and Appalachian communities: Each of the 
sites participated in either the National Follow 
Through Program (a hatjbhwide cbrnpehsatbry 
Q<^Ucat lori prbg ram of t he^ u.s. Depart men t of 
Education) or a malnstreamlng program for gift- 
ed and rhiidly hahdlcapped^tudents sponsored 
by the Special Educatlbri Prbgram bt the U.S. 
Department of Education. 

Measures 

Data for the study were bbtalhed thrbUgh three 
sets of rneas^ures: the /mp/emenfaf/on Assess- 
ment Battery for Adaptive Instruction, the 



LOG _ 
School: _-JL-J-: bittrict; 7^ ._ Grmdm: ^ 

T,,^- X X Diti: }j(^»X.^rijUA. J SMI Tim,. f y^- /0:30 
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foJjuCy Ci^Uj^ CJ^^^'tjC /.^^ JjUL^ 
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schTOj districts' staff develbprheht plans, and 
the monthly trammg logs kept by the sites' edu- 
cation specialists; 

l^Nf ^Antatlbn Assessment Battery for Adap- 
tive instructjon. The battery was administered 
during October, February, and April of Uie 
1980-^1 school year in each of the classrooms; 
The resulting data were analyzed and reported 
in the format illustrated in Figure 2. Ofpartlcular 
Interest in this study were the changes In the de- 
gree of implementation between data collection 
periods. 

Staff Development Plans. A staff develop- 
meht plan, as shown In Figure 3, was designed 
for each site at the beglhhihg of the 1980-81 
school year; The critical dlrneris[0hs requiring 
Improvement were identified through analysis 
of the sites* degree of Implementation data for 
t^^l'J^BO, and other related dat^ as stu- 
dents' learning prog ress [n the ALEfcTs curricu- 
lum and the results of standardized achieve- 
ment tests. As mentioned previously, staff 
^oyo^PP'^Qnt plans ar^^ thrcughbut the 

school year according to sltes^^changlrig train- 
ing needs, information on changes in staff de- 
velbprheht plans was analyzed in terms of spe- 
^^[c critical dimensions reqUirihg Imprbyed 
implementation and the nature of the prescribed 
training activities. 

Monthly Trainlng^^^ Data bh the actual im- 
plementation of training activities prescribed in 
the sites' staff deveiopment pians were ob- 
tained from the mbhthly tralhlhg logs prepared 
^P''J53^^5*s3S''0om by educatlori specialists. As 
shown in Figure 4, information Is categorized 
according to (a) classroom observations of stu- 
b^ht-teacher behavlbrs assbclated with the 
AtErers critical d^^^^^ sug- 
gested by education specialists for|mpj'qylng 
the impiemehtatlbh of particular critical dimen- 
slbhs, (c) expected butcbrhas of the suggested 
training strategies, and (c^) findings of fbllbw-up 
observations. 

Results 

Information obta[hed^ f^^ the three sources 
forms the basic data set for the study. Th^data 
were analyzed to investigate the relationship 
between staff develbpmeht plans and prbgrarh 
L'^Pj^!n®ni%tjo|i ne^ 

gree of implementation scores for individual 
teachers. Specifically, the data served as the 



basis for answering three related cjuestldhs: Did 
the staff deveiopment pian for each site reflect 
the individual staff's program Impiementation 
needs? Were the sites' training actiymes re- 
lated to the staff deveioprnenj p[ans? Did de- 
gree of Implementation scores improve as the 
result of specific tralhlhg activities? 

Consistency between Staff Development Plans 
and Identified Pn^gram Impjemeritatibh Needs. 

To determine whether the sites' staff develbj}- 
rhent plans were consistent with their identified 
tr|Unlhg needs, the d^^ of Implementation 
scores frorn fall^ l^^and the sites' bverall 
1980-81 staff development plans were anal- 
yzed. The training objectives iisted In the staff 
^Q*Ql9PMQntPl#hs were analyzed. The training 
objectives listed In tfie staff develbpmeht plan 
were compared to the critical dimensions in 
which degree bf Implementation scores feli be- 
L°*JJTQ?5^% crlteribh level. The percentages of 
agreement between the two sets of data were 
caicuiated. 

Results bf the analysis are reported jn Table 
1- As_^!?*^*^Jnl^Q ^3it)ie, the staff develbpmeht 
pians excluded 98% of the dimensions with 
scores at or above the 85% criterion level (an in- 
dlcatibn that hb special tralhlhg was needed), 
w^''?M*?^ojof thedirneri scbres below 

the criterion level (an Indication that tralhlhg 
was needed) were included in the staff deveiop- 
ment plans. In bther wbrds, there was 86% 
^9'''??'™Q^ J^^ween the specific perfbrrtiahce 
indicators for which the data suggested the 
heed for training and the training activities/ob- 
lectlyes Iriciuded Jri the staff development 
plans: Similarly^ 98% agree was achieved 
between the data indicating no tralr^ing was 
heeded and the critical dimensions excluded 
trbrti the staff develbpmeht plans. The overall 
data suggest that the sites'^ staff develbpmeht 
plans were highly consistent with the training 
heeds identified In the data. 

it is riqtewdrthy that Investigations bf the ex- 
clusion from the sta^f development plans of 
14% of the critical dimensions with scores be- 
Ibw the crlteribh level reveaied that these dl- 
^Qnslons were Iriclu^ the plans designed 
for individaaneachers. Because only a few bf 
the sites' teachers were involved, training in 
these dimensions was excluded from the sites' 
dverall staff develbprheht plans. 

Cbhsistehcy betweih Identified Staff Develop- 
ment Needs and Traihihg^Actl vltles. To In ves- 
tlgate the extent to which the prescribed train- 
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P«rcinti9t of Agft«fntnt Bttwitn ttit Sitw' Degrei of implemtntation 
Oiti and Staff b«vtjopm«nt Plans 
Fail. 1980 



Staff btvfliopmant Pians 



Ptr(^tagt of Criticil DLrnwnsibns Piromtagi of Cnti^l Dimen 

Pigrte of Program Not Ihdudwi in Staff Indodtd in Staff 

Inpliftiihtitibn Divilop ffiint Ptins Dtvtiopmant Pians 



Perctntagi of Critical 

Din^siqnt At or Abbvi 98 

ttii 85% Critff ion tavtl 



Ptrcantag* of Critical 

Pimintions B«low thi 85% 14 
Critifibn Livtl 



Ini icJiviUes actaaHy were condacted to 
accomplish the specific tralrilrijg objectives 
Identified In the staff developnientplari^^^^ 
latibn analyses were _c^^ 
prescribed jralnlng activities and those re- 
corded In the education specialists' monthly 
logs. Each entry In the l^_waa ;clMS[fled as re- 
lating to brie of the ALEM's IZ^rm^^ 
sjqns, based on the relationship of the naturebf 
the training activity to one (or mor^ of the 96 
perforrnance Indicators. The resujt was a llst^ 
f or each of the 1 19 teachers on whom data were 
available, of the number of training-related con- 
tacts in each of the dlmenslbris. The reliability 
of this process was calculated from the perceji- 
tage bf agrTOrrierit scores for two raters. These 

scbres were consistently above 98%. 

Table 2 summarizes the cbrrelatlbns between 
the critical dJmehslbris Included Tri the^staff de- 
veroprnerit plans and th e n umte^^^ ^jrn'^s traln- 
irig relatCKd to those dimensions was iistbd in the 
education specialists* mbrithiy logs. The cbrte- 
iatlons we7e all positive in directlbrij ranging Jn 
magnitude from .05 (Traveling) to^59 (Arranging 
Space arid Facilities). Significant congelations 
were found in 8 of the 12 dimensions, and an 
overaii significant cbrrelatloh was found (r = 
;37;p<.01). 
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NitiM ifid Pattenw of ChanoM OtMMMvsd 
ttm RmuII of trainino- to examine the extent 
to which traihirig based on staff development 
plans was effTOtlve Jri Jmproylng^t^^^ of 
prc^ram jmplemeritation, changes in degree of 
Implementation data between the fall, 1980. arid 
spring, 1981, data cbllectibri p^riixjs were ana- 
lyzed. Table 3 imports Summarle^^ 
'an juid sprjng average percentage scores for 
each of the 12 critical prbgram dlmenslbris 
along with changes m thetwdscpres. WW[e t^^ 
magnitude bf changes In the 10 sites* degree 
of implementation scores varied, pbsltlve 
changes were observed In all sites In a rriajbiity 
of the critical dlmerisforis. Iri fact^ 88% oMhe 
total riurrit}ef bf scbreaLon aH the criticai^ 
siqris across al| 10 sites Improved or remained 
stable- Analysis of the overall charijaes Iri the 
sites* degree of Jriipjerheritatlbri scb^^ was sta- 
tistically slgrilflcarit at the .01^1^^ 

An anajysls ajso was done of the relationship 
between the critical dlmenslbris shbwri Iri both 
the fail data arid the edUcatlorial specialists^ 
riibnthly lojas as ribt hayliig met Jhe chterion 
level arid the critical dimensions shown in the 
spring data as not having met criterlbri. The re- 
suits of this analysis across the sites shbwCHj 
that the riieari riuriiberbf critical dimensions not 
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Table 2 

^"^^ ^•^^••r* P^i^'C*' Dirnensibni jdentified In 
Staff Davelopment Plans and Training ActivititiS Listed in Monthly Lo^ 

1980-81 
m - 119Te»chirs) 



Critical Dimensions 



Arranging Space and Pacilltlts 



.59 



Significance 



<.05 



Creating and Miinaining 
instructional Materials 



.48 



<d5 



Establishing and ComrnQni^tirtg 
Rules and Procedures 



.45 



<.05 



Managing Aides 



.14 



Testing 



^3 



<05 



Record Keeping 



.33 



<05 



Monitoring and Diagnosing 



.17 



N.S. 



Prescribing 
Triyiliftg 



.29 



.05 



N.S. 



Instructing 
Motivating 
Student Planning 



.13 



.57 



.36 



N.S. 



<.05 



<,05 



meeting the85% criterion ievei In fail, I98d. was 
four. By spring, 1981, the mean number of di- 
mensions not meeting the criterjon level was re- 
daced to two. This redaction is statistically sig- 
nificant (p<:.01). 



To assess the extent to which changes in de- 
gree of implementation for specific critical dl- 
mehsldhs were the result of planned staff devel- 
ojjnnent activities, j;d rhade of 

the changes In (a) the degree of Implementation 
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of the critical dlrtierisldhs Identified In the staff 
development PLans as areas in which tralrilrig 
was needed and those dimensions Identified In 
the monthly logs as areas in which training ac- 
tually tooR place and lb) the critical dimensions 
^J^^^J^[^J^9^APPP3^J^ the monthly logs. The re^ 
suits are reported In Table 4. 

Table 4 shows that greater increases were 
found In the fall and spring degree of impiemen- 
*?L^PG ^^ore^Lfo'ldrm in which training 

took place than In the scores for dimensions not 
Inciuded In the training. Of the 1,108 critical dl- 
monslons In which tralrilng_tdqk place, 80% 
(^^) showed im other hand, 

only 40% (219) the 548 critlcaj dirnens^qns for 
which no specific training was planned showed 
Imprbvemeht. Differences were found between 
^t'Q PQJ'pQPtage of critical dimerislbris Included 
in training but not showing any cfmnge^ajid the 
percentage of those excluded from training and 
showing ho change llast cblumh of Table 4). 
Scores jdr orijy 14% (155) bf the critical dimen- 
sions In which training took pjace rerriained 
stabie, whije 52% (285) of the scores for critical 
dimehsibhs hbt Ihcluded In the staff develop- 
ment plans remained stable. 

SUMMARY AND DISCUSSION 

Plfta frqm^ this study ^p^^ 

dence of the feasibility and effectiveness of us- 



ing degree bf i mpiementatldn as a data base for 
designing staff develbpmeht programs that 
'^Q^l^M ^^ainin^g rieeds^f jndlvid^ua teachers. 
Three major findings from the study seem most 
relevant to Increasing understanding of, and im- 
prbvlrig capabilities tb pj-ovide, effective staff 
^Q^^'oP'ILQI^l.sys^Q^is. First, Jnjqrmatiqri de- 
rived from degree of Implementation measures 
that are based on the use of specific perfor- 
rtiahce ihdicatbrs is useful In Idehtifylhg staff 
development needs for jmprav^ prbjgram Im- 
piementation: Second, staff development activi- 
ties designed oh the basis of identified needs 
can be effective In Improving the degree of Im- 
P'?'?^Q"tatlqn q^ program dimehsibhs. 

Finaiiy, training does make a diff^rejice^ Teach- 
ers tend tb imprbve their program impiementa- 
tibh In areas where specific staff develbprheht 

work Js conducted. 

The long-range implication of this work cen- 
ter bri the development of much-needed techni- 
cal sUppbrt for schbbis in their efforts tb prbvlde 
relevant qr^gqin^ A^aff dev^[qpment prbgrartis 
that meet changing implementation needs. Al- 
thbugh prelimlriary evidence ^eems to support 
t^JLpf t^tlvehess bf the Data-Based Staff Deyel- 

9Pi^?n^_^''°j9'?n^i JJ^'s stA^lyjepr^ phjy a 
first step: At least two types of further research 
and develbpmeht work are needed. One obvious 
line of future work includes replication bf this 



Table 4 

Corhparisbn of Patterns of Changes m Degree of Impjernentation 
Betv»een Fall. 1980 and Spring. 1981 
(N - 138 Teachers) 



Olreeiion of Change 
in Degree of Implementatibn Score* 



Critical Dimensions Increase Decrease No Change 



Number of 1108*' 886 67 ISS 

Criticjl Dimensions (80%) (6%) (14%) 

InclQded in 
Tramihg 



Number_of 548** 2l_9 44 285 _ 

Critical Dimensions (40%) (8%) (52%1 

ixciuded from 
Training 



Note. •x2-287.a p > 01 

Represents the sum of the critical dimensions across all 133 teachers 
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study and add[tjonal detaUed descNp^^^ 
ies of the impiGmentation and oatcomes of the 
Data-Based Staff Development Program, in 
such studies, other sources of efficacy Informa- 
tion should b;^ tappejj(B.g.^teache_rs\educatlo^^ 
speciaiists', &r:d other professional staffs' as- 
sessments of the usefulness or the data-based 
approach). Moreover, ernphasis should be pl^^ 
on documenting the var|qus alternative strate- 
gies employed by teachers and other school 
personnel iri_ systematicajly using the Data- 
Based Staff Developrnent Prograrn. In addition, 
farther refinement^ ^P_^?^?}^P^PP^JAy^^P'^' 
spread use of the data-based approach dis- 
cussed here depends, to a great extent, oh the 
availability of detailed inf^^ on how the 

program can tse integrated to support ongoing 
staf' development efforts. For example, infor- 
mation Is needed oh the types of tralhlng activi- 
ties designed and Used* the decisioh-rnaRihg 
rules used to prioritize tra|ning needs^the time 
requir9d for and spent on certain types of train- 
ing activities, the extent of teachers' involve- 
nlent In desighihg specific training activities, 
and the efficacy of various training strategies in 
meeting Individual staffs' training needs: 

The second line of research needed In this 
general topic area is ihvestlgatlbh of the **ger1er- 
. allzability^' j^f the particular data-based ap- 
proach described in this article. At least two 
types of studios are heeded. The first would In- 
volve testln^g the validity an^ using the 
Data-Based Staff Development Program to im- 
prove teachers* expertise In providing adaptive 
ihstructloh in classrooms where educatrohal 
P!'?9''?r^s _other than the ALEM are imple^ 
mented: The second type of study would focus 
on Investigating the use of the basic strategies 
and concepts of the data-based approach to 

A®Y®'9P^_®^^_ A^i^i^^Pl^'oAw't^^ the im- 
plementation of a variety of innovative pro- 
grams In a wide range of educational settings. 
The objective of this lihg of research would be to 
docurnent the ajternaMve jpjes that can be 
played by such a staff development approach in 
helping schools implement different types of 
prbgranis aimed at delivering improved educa- 
tional services. 

The basic question to be addressed in investi- 
gations of the generallzabillty of thn Data- 
Based Staff Deveropmeht Program wouid be; Is 
t^h[s particular tramlng program, w^^ 
ates the At:iM's degree of implementation 
measures, effective in providing training for the 
develdprnoht of expertise required to success- 



tully iniplemeht other adaptive education pro- 
grams? Results from this line of r^^^^ not 
only would provide external validation of the 
ALEM's design, but also could prove to be very 
^"m^iyi^jjn the development of a systematic me^ 
thodology for improvjng the Irnpiementatlorl d^ 
programs with goals similar to those of the 
ALEM. 
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